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Abstract 

Stopping sets and stopping set distribution of an low-density parity- 
check code are used to determine the performance of this code under 
iterative decoding over a binary erasure channel (BEC). Let C be a 
binary [n, k] linear code with parity-check matrix H , where the rows 
of H may be dependent. A stopping set S of C with parity-check 
matrix H is a subset of column indices of H such that the restriction 
of H to S does not contain a row of weight one. The stopping set 
distribution {7 1 i (iJ)}" =0 enumerates the number of stopping sets with 
size i of C with parity-check matrix H. Note that stopping sets and 
stopping set distribution are related to the parity-check matrix H of 
C. Let H* be the parity-check matrix of C which is formed by all the 
non-zero codewords of its dual code C^. A parity-check matrix H is 
called BEC-optimal if T. t (H) — T. t (H*), i = 0, 1, . . . , n and H has the 
smallest number of rows. On the BEC, iterative decoder of C with 
BEC-optimal parity-check matrix is an optimal decoder with much 
lower decoding complexity than the exhaustive decoder. In this paper, 
we study stopping sets, stopping set distributions and BEC-optimal 
parity-check matrices of binary linear codes. Using finite geometry in 
combinatorics, we obtain BEC-optimal parity-check matrices and then 
determine the stopping set distributions for the Simplex codes, the 
Hamming codes, the first order Reed-Muller codes and the extended 
Hamming codes. 
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I Introduction 

It is well known that the performance of an low-density parity-check (LDPC) 
code under iterative decoding over a binary erasure channel (BEC) is com- 
pletely determined by certain combinatorial structures, called stopping sets, 
of the parity-check matrix of the LDPC code [2]|23]. The weight distribu- 
tion of a linear code plays an important role in determining the performance 
of this linear code under maximum likelihood decoding over a binary sym- 
metric channel. The so-called stopping set distribution characterizes the 
performance of an LDPC code under iterative decoding over BEC. Stopping 
sets and stopping set distributions of linear codes have been studied recently 
by a number of researchers, for examples, see [I]-[I1], [E]-[l7], [E]-[23] and 
[26]-[32]. 

Let C be a binary [n,k,d] linear code with length n, dimension k and 
minimum distance d. Let H be an m x n parity-check matrix of C, where the 
rows of H may be dependent. Let I = {1,2, ... ,n} and J = {1,2,..., to} 
denote the sets of column indices and row indices of H, respectively. The 
Tanner graph Gh |25| corresponding to H is a bipartite graph comprising of 
n variable nodes labelled by the elements of /, m check nodes labelled by the 
elements of J, and the edge set E C {(i,j) : i G I,j G J}, where there is an 
edge (i,j) G E if and only if hu = 1. The girth g of Gh, or briefly the girth 
of H , is defined as the minimum length of circles in Gh- A stopping set S of 
H is a subset of column indices {1, 2, . . . ,n} such that the restriction of H 
to S, say H(S), does not contain a row of weight one. The smallest size of a 
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nonempty stopping set, denoted by s(H), is called the stopping distance of C. 
The codewords with minimum weight d are called the minimum codewords 
of C. Let W(x) = Yl^o-A-iX 1 denote the weight enumerator of C, where 
Ai is the number of codewords with weight i. {Ai}f =0 is called the weight 
distribution of C . The stopping sets with size s(H) are called the smallest 
stopping sets of H. Let T^ H \x) = Y17=oTi(H)x l denote the stopping set 
enumerator of C with parity-check matrix H, where Ti{H) is the number of 
stopping sets of H with size i. Note that is defined as a stopping set and 
Tq(H) = 1. {Ti(H)}™ =0 is called the stopping set distribution (SSD) of C 
with parity-check matrix H. Note that the stopping sets and stopping set 
distribution dependent on the choice of the parity-check matrix H of C. 

Schwartz and Vardy |23j defined the stopping redundancy of the binary 
linear code C as the minimum number of rows of H such that s{H) = 
d. Etzion [4j studied the stopping redundancy of Reed-Muller codes. In 
particular, the stopping redundancies are determined respectively for the 
Hamming codes [23], the Simplex codes and the extended Hamming codes 
[I], and an upper bound on the stopping redundancy of the first order Reed- 
Muller codes was obtained in [I]. In this paper, we study a similar concept of 
the binary linear code C, BEC-optimal parity-check matrix, in which both 
the number of stopping sets and the number of rows are minimal among all 
parity-check matrices of C. 

Suppose a codeword c = (ci, C2, . . . , c n ) € C is transmitted over the 
BEC. Let r = (n, T2, • • • , r n ) be the received word. The erasure set is defined 
by E r = {j : rj ^ 0, 1}. An incorrigible set of C is an erasure set which 
contains the support of a non-zero codeword of C. As noted by Weber and 
Abdel-Ghaffar in [28j, the received word r can be decoded unambiguously 
if and only if it matches exactly one codeword of C on all its nonerased 
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positions. This is equivalent to the condition that the erasure set E r is not 
an incorrigible set since C is a linear code. A decoder is said to be optimal for 
the BEC if it can achieve unambiguous decoding whenever the erasure set is 
not incorrigible. Note that an exhaustive decoder searching the complete set 
of codewords is optimal. Let H* be formed by rows which are all the non- 
zero codewords of the dual code C 1 - , and denote its stopping set enumerator 
by T*(x) = X^r=o^T xJ - The iterative decoder with parity-check matrix 
H* achieves the best possible performance, but has the highest decoding 
complexity. It is also known from [28] and |12] that the iterative decoder 
with parity-check matrix H* is an optimal decoder for the BEC. For fixed 
parity-check matrix H, since if is a sub-matrix formed by some rows of H* , 
any stopping set of H* is a stopping set of H, but the converse proposition 
may not be true in general. Hence, we have Ti(H) > T* for every < i < n. 
A parity-check matrix H is called BEC -optimal if T^ H \x) = T*(x) and 
H has the smallest number of rows. Since a BEC-optimal parity-check 
matrix has the same SSD with H*, the iterative decoder with BEC-optimal 
parity-check matrix must be an optimal decoder and it has lower decoding 
complexity than H*. Moreover, it achieves the best possible performance as 
the iterative decoder with parity-check matrix H*. 

For the binary [2 m — 1, 2 m — m — 1, 3] Hamming code, say *H(rn), it is 
known from |23| that for any parity-check matrix, the stopping distance is 
equal to the minimum distance. In the 2004 Shannon lecture, McEliece |19j 
gave an exact expression for the number of smallest stopping sets of H(m) 
with the full rank parity-check matrix F, i.e., 

T 3 (F) = -(5 m - 3 m+1 + 2 m+1 ). (1) 
6 

Recently, Abdel-Ghaffar and Weber [1] further determined the whole SSD 
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of T-L{m) with the parity-check matrix F. Prom [18] we know that 

A 3 = i(2 m -l)(2 m - 1 -l) (2) 

and A 3 < T 3 (F), i.e., F is not BEC-optimal. Weber and Abdel-Ghaffar [27] 
showed that for the parity-check matrix H*, T 3 (H*) = A 3 and T 4 {H*) = At, 
but they did not determine the whole SSD of H* . In this paper, we obtain 
BEC-optimal parity-check matrices and then determine their SSDs for the 
Simplex codes, the Hamming codes, the first order Reed-Muller codes and 
the extended Hamming codes by using finite geometry theory. Moreover, 
the above BEC-optimal parity-check matrices are unique up to the equiv- 
alence. The rest of this paper is arranged as follows. In Section II, we 
give some notations and results in combinatorics that are needed in this 
paper. In Section III, we obtain the BEC-optimal matrices for the Simplex 
codes, the Hamming codes, the first order Reed-Muller codes and the ex- 
tended Hamming codes. In Section IV, in order to determine the SSDs for 
these BEC-optimal parity-check matrices, the stopping generators of finite 
geometries are introduced. In Section V, we determine the SSDs for the 
corresponding BEC-optimal parity-check matrices of these codes. Finally, 
some conclusions are given in Section VI. 

II Preliminaries 

In this section, we introduce some notations and results of finite geometry 
and Gaussian binomial coefficients that will be used in this paper. 

II. 1 Finite Geometries 

Let F q be a finite field of q elements and F™ be the m-dimensional vector 
space over ¥ q , where m > 2. 
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Let EG(m, q) be the m-dimensional Euclidean geometry over F 9 \18\ pp. 
692-702]. EG(m,q) has q m points, which are vectors of ¥ q . The //-flat in 
EG(m, q) is a //-dimensional subspace of F™ or its coset. A point is a 0-flat, 
a line is a 1-flat, a plane is a 2-flat, and an (m — l)-flat is called a hyperplane. 

Let PG(m, q) be the m-dimensional projective geometry over ¥ q [18\ 
pp. 692-702]. PG(m,q) is defined in F™ +1 \ {0}. Two nonzero vectors 
p, p' G F™ +1 are said to be equivalent if there is A € ¥ q such that p = Ap'. 
It is well known that all equivalence classes of F™ +1 \ {0} form points of 
PG(m,q). PG(m,q) has (q m+1 - l)/(q - 1) points. The //-flat in PG(m,q) 
is simply the set of equivalence classes contained in a (// + l)-dimensional 
subspace of F™ +1 . 0-flat, 1-flat, and (m — l)-flat are also called point, line 
and hyperplane respectively. 

In this paper, in order to present a unified approach, we use FG(m, q) 
to denote either EG(m,q) or PG(m,q). Let n denote the number of points 
of FG(m,q). All points of FG(m,q) are indexed from 1 to n. We will 
use i to denote the i-th point of FG(m, q) for convenience if there is no 
confusion. For any two different points € FG(m,q), there is one and 
only one line, say L(i, i'), passing through them; for any three distinct points 
S FG(m,q) which are not collinear, there is one and only one plane, 
say M(i,i' passing through them. For a set of points II C FG(m,q), 
let x(n) = x 2, ■ ■ ■ , x n ) denote the incidence vector of II, i.e., Xj=l if 
i € II and Xi = otherwise. For u > 0, a u-set means a set of u points 
of FG(m,q). For a non-empty subset S of FG(m,q), define (S) as the 
flat generated by the points in S, i.e., (S) is the flat containing S with the 
minimum dimension. Clearly, (S) solely exists and for any flat F ~D S, 
(S) C F. The next lemma is obvious. 

Lemma 1 Let U be a non-empty subset of FG(m,q). Then H is a flat if 
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and only if (S) C II for any non-empty 5CII. Moreover, 

(i) . Let II C PG(m — 1,2) and \H\ > 2. Then II is a flat if and only if 
L(i,i') C II for any two different points i,i' £ II; 

(ii) . Let II C EG(m,2) and \U\ > 3. Then II is a flat if and only if 
M(i,i',i") C II for any three distinct points i,i',i" € II. 

For < fi± < fi2 < Tn, there are ./V(//2,//i) //i-fiats contained in a given 
/i2-flat and ^4(//2> //i) //2-flats containing a given //i-flat, where for EG{m, q) 
and PG(m,q) respectively (see [23]) 

Neg{j»,h) = f- w n L-Hi_ r (3) 

i=0 y 

-ABG(M2iMl) = 4pg(M2,Mi) = II qW -»+l - 1 " ^ 

For 1 < // < m, let n = N(m, 0) and J = N(m, //) be the numbers of points 
and //-flats in FG(m, q) respectively. The points and //-flats are indexed 
from 1 to n and 1 to J respectively. Let 

H = H FG (m,n) = (hji) Jxn (6) 

be the point- //- flat incidence matrix, where hji = 1 for 1 < j < J and 
1 < % < n if and only if the jth //-flat contains the ith point. The rows of H 
correspond to all the //-flats in FG(m, q) and have the same weight iV(//, 0). 
The columns of H correspond to all the points and have the same weight 
A(/i, 0). The binary linear code with the parity-check matrix H is a class of 
LDPC codes based on finite geometries [24j[15j[30j, denoted by CFG{ m -> I 1 )- 
Clearly, the girth of H is 6 if // = 1 and 4 otherwise [24J. Xia and Fu [3U] 
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proved that 



m-n+l _ i 

d > s(H)>A(ji, l i-i) + l = * + 1. 

q-1 



(7) 



Clearly, for q = 2 and 2 < fj, < m, CEcim,^) is the (fi — l)-th order 
Reed-Muller code RM(m,n — 1) [18j[24j. Since the minimum distance of 
RM(m,fj, — 1) is 2 m_ ^ +1 , by ([7]), the stopping distance is equal to the min- 
imum distance. 

II. 2 Gaussian binomial coefficients 

For non-negative integers m < n, let 

= IF — 



i=0 



1 



(8) 



denote the g-binomial coefficient or Gaussian binomial coefficient |18t pp. 443- 
444]. In this paper, we will omit the subscript q when q = 2. It is easy to 
check that 
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The well-known Cauchy Binomial Theorem states that 

m m 

n(i+^) = e 



i=0 



rm 
L i 



i(i+l)/2 x i_ 



(11) 



From now on, we will always assume that q = 2. As usual, we define 



= i, © = o, [S] 



1. 



Letting x = — 1/2 in (fTT]) . we have that 

m 

J2 \ m ] 2 ^- 1 )/ 2 (-l) i 



i=0 



Jm,0; 



(12) 



where 5 m>n = 1 if m = n and b m ^ n = otherwise. It is easy to check by 
©-© and P-P]) that 



^Vpg(M2,Mi) 

A(fJ, 2 , Ml) 
N(l,l-j)N(l-j,k) 



M2 + 1 



Ml 
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Ml 



m — fi\ 

M2 - Mi 
/ - fc 

J 



iV(/,fc). 



(13) 
(14) 
(15) 
(16) 



III BEC Optimal Parity-Check Matrices 



In this section, using finite geometry theory, we obtain the BEC-optimal 
matrices for the Simplex codes, the Hamming codes, the first order Reed- 
Muller codes and the extended Hamming codes. 

The points of PG{m — 1,2) are simply the nonzero vectors of F™. A 
//-flat of PG(m — 1,2) is simply the nonzero linear combination of fj, + 1 
linearly independent points. By (jj]) and ([5]), PG(m — 1, 2) has 2 m — 1 points, 
(2 m — l)(2 m_1 — l)/3 lines and 2 m — 1 hyperplanes. Moreover, every line 
contains three points. 

The points of EG(m,2) are simply the vectors of F™. A ^-flat of 
EG(m,2) is simply a /x-dimensional subspace or its coset. By ([3]) and ([5]), 
EG(m,2) has 2 m points, 2 m " 1 (2 m - 1) lines, 2 m " 2 (2 m - l)(2 m - 1 - l)/3 
planes and 2 m+1 — 2 hyperplanes. Moreover, every line contains two points, 
every plane contains 4 points. 

Let RM(m,r) be the r-th order binary Reed-Muller code |18t Ch. 13]. 
By puncturing a fixed coordinate from all codewords of RM(m, r), we obtain 
the punctured Reed-Muller code RM(m,r)* . 
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Lemma 2 \18\ p. 381, Th. 10] The incidence vectors of all the (m — r — 1)- 
flats of PG(m - 1,2) generate RM(m,r)*. 

Lemma 3 \18\ p. 385, Th. 12] The incidence vectors of all the (m — r) -flats 
of EG(m,2) generate RM(m,r). 

It is well known that RM(m,m — 2) is the binary [2 m ,2 m — m — 1,4] 
extended Hamming code, which is also denoted by j-L(m); RM(m, 1) is the 
dual code of 7-£(m) and a binary [2 m , m+1, 2 m_1 ] linear code; RM{m, m—2)* 
is the binary [2 m — 1, 2 m — m — 1, 3] Hamming code, which is denoted by 
7i(m); the shortened RM(m, 1), or the Simplex code S(m), is the dual code 
of H(m) and a binary [2 m — l,m,2 m_1 ] linear code. 

In PG(m - 1,2), by ©, let 

ff« =ff PG (m- 1,1) (17) 

be the (2 m - l)(2 m " 1 - l)/3 X (2 m - 1) point-line incidence matrix. Clearly, 
has uniform row weight 3 and uniform column weight 2 m ~ l — 1 and 
girth 6. By ©, let 

H {2) = H PG {m - 1, m - 2) + J, (18) 

where Hpc(m—1, m—2) is the (2 m — 1) x (2 m — 1) point-hyperplane incidence 
matrix and J is a (2 m — 1) x (2 m — 1) all-1 matrix. It is obvious that for 
any hyperplane P, the incidence vector of P = PG(m — 1, 2) \ P is a row 
of #( 2 ) and vice versa. Clearly, .£f( 2 ) has uniform row weight 2 m 1 , uniform 
column weight 2 m ~ 1 and girth 4. 

Lemma 4 is a parity-check matrix of S(m) and the rows of form 
all minimum codewords ofT-L(m). is a parity-check matrix of H(m) 

and the rows of form all nonzero codewords of S(m). 
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Proof: By LemmaEl the lines of PG{m — 1, 2) generate RM(m, m — 2)* 
or H(m)i which implies that is a parity-check matrix of S(m). Since 
the number of weight 3 codewords of T-L(m) is exactly (2 m — l)(2 m_1 — l)/3 
[181 P- 64, Cor. 16], the rows of form all minimum codewords of ?i(m). 

For the second part, since there are 2 m — 1 rows in and S(m) has 
2 m — 1 non-zero codewords, it is enough to show that every row of 

is 

orthogonal to all rows of ffW. Let x(P) be a row of where P is a 

hyperplane of PG(m — 1,2). By [181 P- 697, problem (8)], any line L either 
intersects P on a unique point or lies in P. Since L has three points, L can 
intersect P on either one or three points, i.e., L can only intersect P on zero 
or two points, which implies that x(£) is orthogonal to x{P)- This finishes 
the proof. □ 
In EG(m,2), by ©, let 

H®=H EG {m,2) (19) 

be the 2 m ~ 2 (2 m - l)(2 m ~ 1 - l)/3 x 2 m point-plane incidence matrix. By 
Lemma [31 generates H(m), which implies that is a parity-check 
matrix of RM{m, 1). Clearly, has uniform row weight 4 and uniform 

column weight (2 m - l)(2 m - 1 - l)/3 and girth 4. By flBJ, let 

=H EG (m,m-l), (20) 

be the (2 m+1 - 2) x 2™ point-hyperplane incidence matrix. By Lemma El 
H ( 4 ) generates RM(m, 1), which implies that i?( 4 ) is a parity-check matrix 
of 'Him), Clearly, has uniform row weight 2 m ~ 1 , uniform column weight 
2 m - 1 and girth 4. 

Hence, H^\H^ 2 \H^,H^ are respectively the parity-check matrices 
of S(m), 7i(m), RM(m, 1), T-L(m), and their rows are formed by all minimum 
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codewords of the dual codes. For convenience, we list the results in the next 
table, where x(') denotes an incidence vector, L a line, M a plane, P a 
hyperplane, and P = PG{m — 1, 2) \ P. 

S{m) PG(m - 1, 2) ffW has rows formed by all H^> 

H(m) PG(m - 1, 2) F (2) has rows formed by all x(-P) # {2) * 

i?M(m, 1) EG(m, 2) ff< 3 ) has rows formed by all x(M) #( 3 )* 

#(m) EG(m, 2) ff* 4 ' has rows formed by all xOP) # {4) * 

Moreover, H^* , H( 2 > , H&> , HW* have rows formed by all non-zero code- 
words of H(m), S(m), H(m), RM(m, 1), respectively. Clearly, F^ 2 ) = #( 2 )* 
and is formed by all rows except the all-1 row of H^>. 

Proposition 1 Let C be a binary linear code with parity-check matrix H . 
Let C 1 - be the dual code of C . The minimum distance d ± of is at least 
3. Then a necessary condition of T^ H \x) = T*(x) is that all minimum 
codewords of are contained in rows of H. 

Proof: Assuming the contrary that there is a minimum codeword of 
C ± , say yo, is not in the rows of H, it is enough to show that there is 
a stopping set S of H such that S is not a stopping set of H*. Fixing 
a coordinate io £ supp(yo), let S = supp(yo) U {io}, where supp(yo) = 
{1, 2, . . . , n} \ supp(yo). Since S n supp(yo) = {io}, S is not a stopping set 
of H*. On the other hand, for any non-zero row y of H, we will show that 
\S n supp(y)| > 2 which implies that S is a stopping set of H. Clearly, y 
is a non-zero codeword of C 1 - other than yo- We claim that |supp(yo) PI 
supp(y)| > 2. Assume the contrary that |supp(yo) nsupp(y)| < 1. Then 

|supp(y ) Hsupp(y)[ = |supp(y)| - |supp(y ) nsupp(y)| > |supp(y)| - 1. 

Clearly, d#(y,y ) > d 1 - and w H (y) = |supp(y)| > d 1 - = w H (yo)- Hence, 

dtf(y,yo) = w H (y) +w H (yo) - 2|supp(y) nsupp(y )| 
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< w H (y) + w H (yo) - 2(w H (y) - 1) 
= w H (yo) - w H (y) + 2 < 2, 



which leads a contradiction. Hence, |supp(yo) Hsupp(y)| > 2, which implies 



that \S n supp(y)| > |supp(yo) fl supp(y)| > 2 and thus S is a stopping set 
of H. This completes the proof. □ 

Proposition 2 Xei C be a binary linear code with parity- check matrix H. 
Then a sufficient condition of T^ H ) (x) = T* (x) is that for any non-zero 
stopping set S of H , 

S= |J supp(x). (21) 

xGC,supp(x)CS' 

Proof: Let S be a stopping set of H and S = UxeCsupp(x)cs supp(x). 
We only need to show that S is also a stopping set of H* , i.e., for any fixed 
row of H*, say y, \S n supp(y)| ^ 1, or 



|J supp(x) n supp(y) 

xGC,supp(x)C5 



+ 1. (22) 



Since y represents a parity-check equation of C, supp(x) n supp(y) must 
have even number elements for any x G C. Thus (|22p holds, which finishes 
the proof. □ 

Remark 1 Suppose a parity-check matrix HofC is formed by all minimum 
codewords of C 1 - with d > 3. It is easy to see by Propositions [1\ and&that 
H is BEC-optimal provided that H satisfies the condition of Proposition® 

Lemma 5 LetS(m) be the [2 m — 1, m, 2" 1-1 ] Simplex code with parity- check 
matrix Then S C PG(m — 1, 2) is a stopping set if and only if S = 

PG(m- 1,2) or 5 = PG(m - 1,2) \ 5 is a ofPG(m- 1,2). 
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Proof: By the definition of stopping set, S C PG(m—l, 2) is a stopping 
set if and only if H^\S) has no rows with weight one, i.e., |Ln5| 7^ 1 for any 
line L. Since L has only three points, iLnSI 7^ 1 is equivalent to |Ln<S| 7^ 2. 
Hence, S is a stopping set if and only if any line L intersects S on 0, or 1, 
or 3 points. Clearly, if \S\ < 1, this is equivalent to S = PG(m — 1,2) or 
S is a 0-flat. Otherwise, if \S\ > 2, this is equivalent to L(i,j) G 5 for any 
different i, j £ 5. Hence, the lemma follows by (i) of Lemma [TJ □ 
By using (ii) of Lemma [1] and the similar arguments used in the proof of 
Lemma it is easy to obtain the next lemma. 

Lemma 6 Let RM(m, 1) be the first order Reed-Muller code with parity- 
check matrix . Then S C EG(m,2) is a stopping set if and only if 
S = EG(m, 2) orS = EG(m, 2) \ 5 is a flat of EG(m, 2) . 

Theorem 1 H®, , , are the BE C- optimal parity- check matri- 
ces for S{m), T-L(m), RM(m, 1), "H(m), respectively. Moreover, for each of 
the above four cases, there is no other BEC-optimal parity-check matrix up 
to the permutation of rows. 

Proof: Note that the rows are formed by all 

minimum codewords of the dual codes of S(m), ~H(m), RM(m,l), 7-L(m), 
respectively. By Proposition [H we only need to show that T^ H \x) = T*(x) 
for H = HW,HW,H( 3 \HW. 

(i) H = : We show that satisfies the sufficient condition given 
in Proposition [21 Let S be a non-empty stopping set of . We need to 
show that S satisfies (|2ip . If \S\ = n, it is true since there is no codewords 
of weight 1 in the dual code of S(m). Ii 1 < \S\ < n — 1, by Lemma El S is 
a //-flat of PG(m — 1,2), where < fi < m — 2. Let P%, P2, ■ ■ ■ , PA(m-2,fj.) 
be all the hyperplanes which contain S, then S = C\f=t 2 Pj-> or S = 
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Uj=r Pj- Since every Pj is the support of a codeword of <S(m), (j2Tj) 
holds for 5. 

(ii) # = H^: It follows from the fact that = . 
(hi) H = H^: It is totally similar to the case (i). 
(iv) H = : It follows from the fact that is formed by all rows 
except the all-1 row of H^* . □ 

IV Generators in Finite Geometries 

In this section, we introduce the concept of stopping generators of finite 
geometries and give some enumeration results that will be used to determine 
the SSDs for the BEC-optimal parity-check matrices H®, 
of S(m), H(m), RM(m,l), H(m). 

Let S be a non-empty subset of FG(m,2). For any j € S, denote 
Sj = S \ {j}. A point i is said to be independent to S if i £ (S). S is said 
to be independent if for any j G 5, j is independent to (Sj). The empty set 
is defined as an independent set. It is known from [18] that the dimension 
of a flat F of FG(m, 2) is equal to \ J\ — 1, where J is an independent subset 
of F with maximum size. Clearly, for a non-empty set S, S is independent 
if and only if (S) is an — l)-flat. 

For an integer < Z < m, let F^ denote an /-flat of FG(m,2). FW has 
N(l,0) points. Let u > 1, if a u-set generates F®, we call it a u-generator 
of FW. If a u-generator 5 of F« satisfies (Sj) = (S) = F® for any j G 5, 
we call S 1 a stopping u-generator of F^. Define B(u,l) as the number of 
it-generators of F^ and Z) as the number of stopping u-generators of 
FW, i.e, for u > 1 and Z > 0, 

B(«,0 = \{S C F« : |5| = «, (5) = F«}|, (23) 



15 



G(u, I) = \{S C F« : |5| = u, Vj e 5, (5,-) = F«}|. (24) 

Define Z) = if u < or / < 0. Clearly, 

G(u,l) < B(u,l), (25) 
B(u,l) = if«<|. (26) 

For a it-set S, where u > 1, S is a it-generator of a (u — l)-flat if and only if 
S is independent. A non-empty independent set S could not be a stopping 
generator, this is because for any j € S, (Sj) C (S). Hence, G(u,u — 1) = 
for any u > 1. Combining this fact with (|25p -(|26 p . we have 



G(u,Z)=0 ifu<i + l. (27) 

Lemma 7 For any u > 1 anc? / > 0, -B(tt, Z) satisfies the following recursive 
equation 

5(1,0)= 1, S(«,0) = ifu>2, (28) 

W(*>°A = ^JV( ia /> . (29) 

u ' i=0 

Proof: d28D is obvious by fl23J) and {25}. In F^, there are ( JV ^ ,0) ) 
it-subsets, and each of which generates an i-flat, where < i < I. There 
are N(l, i) i-flats in F®, and each of which contains B(u, i) it-generators of 
this i-flat FW. Clearly, these u-sets are distinct, which implies the lemma. 

□ 

Lemma 8 

B(u,l) = ^(-1^-1)^(1^ _ i} ^-^°)^ (30) 



3=0 
I 



3=0 
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(31) 



Beg(u,1) = £(-l)*2>'C*+ 1 )/2 

3=0 



2 l -i 
u 



Proof: By Lemma 

f N(l-j,0) 



1-3 



J2N(l-j,k)B(u,k). 



k=0 



Hence, by (USD and dH, 



N(l-j,0) 
u 



j2(-m^/ 2 N(i,i-j)\ 

3=0 
I 1-3 

j=0 fc=0 
I l-k 



I - k 
3 



N(l,k)B(u,k) 



/c=o j=o 

iV(Z, fc)B(u, k) ■ ^(-l)%'(i-i)/2 

fc=0 j=0 

i 

^iV(^)£(«,&W*-fc,o 

fc=0 

N(l,l)B(u,l) = B(u,l). 



Moreover, (ED and ([32]) follow from fl3Ql) and (fT3l)-(fT4l). 



/-A; 



(32) 



□ 

Lemma 9 Let I > 0, u > I + 1, and S be a u-generator of , where F® 
is an I -flat. Let J = {j £ S : j (Sj)}- TTien 

(i) J is an independent set; 

(ii) J = if and only if S is a stopping u-generator of F® ; 

(iii) J = S if and only if S is an independent set; 

(iv) otherwise, suppose J is a non-empty proper subset of S and \ J\ = k, 
then (S \ J) is an (I — k)-flat, 1 < k < I — 1, and S \ J is a stopping 
(u — k) -generator of (S \ J). 
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Proof: Note that is an independent set according to the definition. 
If J / 0, for any j G J, J C S implies Jj C Sj and (Jj) C Hence, 
j £ J implies j (Sj) and j G" (Jj)- This completes the proof of (i). By the 
definition of stopping generator, (ii) is obvious, (iii) follows from (i) and the 
definition of independent set. Next, we suppose J = {ji,j 2 , • • • , jk} (k > 1) 
is a non-empty proper subset of S and give the proof of (iv). 

Note that (S) = is an /-flat. Since ji G (5) and ji g (S \ {ji}), 
(S \ {h}) is an (/ - l)-flat in (S). Since j 2 € S \ {ji}, j 2 G (S \ {h}). 
Moreover, j 2 (S \ {ji,j 2 }) since j 2 (S \ {j 2 }). Hence, (S \ {ji,j 2 }) is 
an (I — 2)-flat in (S \ {ji}). Repeating the above procedure, we have that 
(S\{ji,j 2 ,j3}) is an (/-3)-flat in (S\ {ji, j 2 }}, . . ., (S\J) is an (Z-fc)-flat 
in {S \ {ji, . . . Since S\ J is non-empty, Z — > 0. If k = I, (S \ J) 

is a single point set, say {i}. Then S \ J = {i} or Si = J. Hence, by (i), 
(Si) is an (/ — l)-flat, which implies (Si) C (S) and i g" (Si). This means 
i € J and leads a contradiction. Therefore 1 < k < I — 1. 

Now, we show that S \ J is a stopping generator, i.e., for any j G S\J, 
(S\J) = (Sj \ J) . Assume by contrary that there exists j* E S\J such that 
Sj* \ J generates an (l — k — l)-flat in (S\J). By using the inverse procedure 
given in the last paragraph, it is not difficult to see that (Sj*\{j\, . . . ,jk~i}) 
is an (/ - fc)-flat, (Sj* \ {ji, • • • Jk-2}) is an (/ - k + l)-flat, . . ., (Sj* \ {ji}} 
is an (I — 2)-flat, (Sj*) is an (/ — l)-flat, which implies that j* (Sj*) or 
j* G J. This gives a contradiction. 

Combining these results, the lemma follows. □ 

Lemma 10 For any I > 1 and < jfe < I, let F® be an l-flat. Then 
there are exactly a(l, k) pairs 

(ir(i-fc) } jW) suc h that F^ C F® is an 
(I - k)-flat, C F« is an independent k-set, and (J^ U F^) = F® , 
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where 

/Vi7 1 — k) k 

a(l,k) = ) -l[[N(l,0)-N(l-k + i,0)}, (33) 

i=l 

k 

a PG (l,k) = ln2^ +1 (2'-+ 2 -l), (34) 

' i=l 

k 

a EG (l,k) = in^^^-l). (35) 

' i=l 

Proof: Clearly, a(l,0) = 1 which implies that (|33p holds for k = 0. It 
is easy to verify (fM)) and (j35|) from ([33]) and ([3j)- d3J) - Hence, it is enough to 
show (|53"|) for 1 < A: < I. Suppose C is a fixed (Z - fc)-flat. We 

enumerate all suitable independent k-set as follows. Choosing the first 
point from \ F^ l ~ k \ there are N(l,0) — N(l — k,0) choices. F^ l ~ k ^> and 
the first point generate an (I — k + l)-flat, say F^ l ~ k+1 \ Choosing the second 
point from F^\F^~ k+1 \ there are N(l, 0) -N(l-k+l, 0) choices. F( l - k+v ) 
and the second point generate an (I — k + 2)-flat, say i^(' _fe + 2 ). Repeating 
the above procedure, we have N(l,0) — N(l — 1,0) choices when choosing 
the k-th point. It is easy to see that there are exactly A;! repetitions for the 
above choosing procedure. Hence, there are totally 

fc-i 

-J[[N(l,0)-N(l-k + i,0)} 
' i=0 

independent sets = {ji, j% y ■ ■ ■ ,jk} to form a suitable pair 

for fixed (I — £;)-flat F^ l ~ k \ Hence, (133p follows from the fact that there are 

N(l, l-k) (I- /c)-flats in F®. □ 

Lemma 11 For any u > 1 and I > 0, G(u,l) satisfies the following recur- 
sive equation 

G(u, 0) = for any u; G(u, I) = for any u < I + 1; (36) 
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l-X 

B(u,l) = ^2a{l,k)G{u-k,l-k), u>l + 2. (37) 

fc=0 

Proof: It is easy to check that (f36|) holds by the definition (}2"1"|) of 
G(u, Z) and (|27p . Below we suppose Z > 1 and u > I + 2. Since it > Z + 2, 
by Lemma [9l each u-generator of -F^ is 1-1 corresponding to a (u — k)- 
stopping generator of an (Z — Zc)-flat of F®, where < k < I — 1. For fixed 
< Zc < Z — 1, by Lemma[TUl there are a(Z, k)G(u — k, l — k) such u-generators 
of F^> . Hence, (J3TJ) follows by counting these u-generators where k is from 
OtoZ-1. □ 

Lemma 12 Let u > I + 2. Then 
i-i 

G(u,l) = ^2(-l) k a(l,k)B(u-k,l-k), (38) 

k=0 



k=0 '"' i=l 



G PG (u,l) = Y / Bp G (u-k,l-k)'^-l[2 l - i + 1 (2 l - i+2 -l), (39) 



l — l u k 

GegM = J2 B ^-^l-k)^-f[2 l - i+1 (2 l - i+1 -l). (40) 

k=0 ' i=l 



a(l,k)a(l — k,j — k) = I \a(l,j). 



Proof: It is easy to check by (|M|) - (j35j) that 

a(Z,0) = 1, 

Clearly, ^2 J k=0 {—l) k ({) = 8j,o- Moreover, by Lemma [TT1 

i-k-i 

B(u — k,l — k) = a (l ~ k, j)G(u — k — j,l — k — j) 



j=0 
1-1 

^a(Z -k,j- k)G{u - j,l - j). 

j=k 
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Hence, using these equations, we have 
l-l 

J2(-l) k a(l,k)B{u - k,l - k) 

k=0 
l-l l-l 

= E Et- 1 )*^' k ) a( l ~ k >i- k W u -j> l ~ i) 

k=0 j=k 

j=0 k=0 ^ ' 

l-l 

= ^2S ji0 a(l,j)G(u - j,l - j) 

j=0 

= a(l,0)G(u,l) = G{u,l). 
Moreover, ^ and ([H follow from (J3S]) and d33D-(I3SD- □ 

V Stopping Set Distributions 

In this section, we determine the SSDs for the Simplex codes S(m), the 
Hamming codes H(m), the first order Reed-Muller codes RM(m, 1) and the 
extended Hamming codes T-L{m) with the BEC-optimal parity-check matri- 
ces H^, H®, H( 4 \ respectively. 

V.l Simplex Codes S(m) 

Throughout this subsection, n = 2 m - 1 and PG(m - 1, 2) = {1, 2, . . . , 2 m - 
1}. By there are A r pc(m — 1, fj,) /i-flats in PG(m — 1,2) and a fi- 
flat has exactly 2 At+1 — 1 points. The next theorem follows from Lemma [5] 
immediately. 

Theorem 2 Let S(m) be the [2 m — l,m,2 m_1 ] Simplex code with parity- 
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check matrix H®. Let {Ti(H^)}f =0 be the SSD ofS(m). Then 



' 1 if i = or 2 m - 1, 

N PG (m-l,n), ifi = 2 m -2»+\ 

fi = 0, . . . , m — 2, 
0, otherwise, 



where 

f 2 m— * j 

^pg(m-l,M)=II 2^+i-r 

i=0 

Remark 2 Let \i = m — 2, by Theorem [2J if is easy to check that the 
number of smallest stopping sets T 2 ™-i (H^ 1 ') = 2 m — 1, which coincides 
with the number of minimum codewords of S{m). 

Example 1 By Theorem [2j we can easily calculate the SSDs of S(m) with 
parity-check matrix by Mathematica software. Here are some examples 
for m = 3, 4, 5. 
For 5(3), 

T(x) = l + 7x 4 + 7x 6 + x 7 . 

For 5(4), 

T(x) = l + 15j; 8 + 35x 12 + 15a; 14 + x 15 . 

For 5(5), 

T{x) = 1 + 31x 16 + 155x 24 + 155x 28 + 31x 30 + x 31 . 

It is worthy to note that all examples in this section besides the above 
one are calculated through two ways, one of which uses the derived formula, 
and the other of which uses the exhaust computer search for verification. 
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V.2 Hamming Codes 'Kim) 

Throughout this subsection, n = 2 m - 1 and PG(m - 1, 2) = {1, 2, . . . , 2 m - 
1}. Note that = and P is a hyperplane if and only if x{P) is a 

row Of HP). 

Lemma 13 Xei Tl(m) be the [2 m — l,2 m — m — 1,3] Hamming code with 
parity-check matrix H^ 2 \ Then S C PG(m — 1,2) is a non-empty stopping 
set if and only if (S) = {Sj} for any j G 5, where Sj = S\ {j}. 

Proof: By the definition of stopping sets, a non-empty subset S C 
PG(m — 1,2) is a stopping set if and only if H^ 2 \S) has no rows with 
weight one, i.e., \P D S\ ^ 1 for any hyperplane P of PG{m — 1, 2). Clearly, 
|P n S\ ^ 1 is equivalent to \P (1 S\ ^ \S\ — 1. Hence, we only need to show 
that \P H SI ^ \S\ — 1 for any hyperplane P of PG(m — 1, 2) if and only if 
(5) = {Sj) for any j € S. 

Firstly, we will prove the necessary condition. Suppose that S satisfies 
\P fl S\ ^ | SI — 1 for any hyperplane P. Clearly, {Sj} C (S). Assume by 
contrary that there exists j € S such that (Sj) C (S), i.e., dj = d — 1, where 
ci,- and d are the dimensions of {Sj) and (S) respectively. If d = m — 1, then 
(Sj) is a hyperplane not including S, i.e., |(Sj) n S| = |Sj| = |S[ — 1, which 
leads a contradiction. Otherwise, if d < m — 1, by , there are j4(m — 2, cf) 
hyperplanes containing S, and there are A(m — 2, dj) hyperplanes containing 
Sj. It is easy to check that for PG(m — 1,2) 

A(m - 2, dj) __ A 2 m ^ - 1 _ 2 m ~ d - 1 

^4(m - 2,d) ~ 1± 2 m ~ i ~ 1 - 1 ~ 2 m ~ d - 1 - 1 > ' 
v ' ; i=dj+l 

which implies that there exists a hyperplane, say P*, such that Sj C P* and 
S ^ -f 5 *- Hence, \P* n S| = |S| — 1, which leads a contradiction. 
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On the other hand, suppose that S satisfies (S) = (Sj) for any j € S. 
Assume by contrary that there exists a hyperplane P* such that \P* D S\ = 
\S\ — 1, i.e., there exists a point j* £ S such that P* n S = Sj*. Then 
Sj* C P* and S ^ P*, i.e., (5,-.) C P* and (5) % P*, which leads a 
contradiction. 

Combining these claims, the lemma follows. □ 

Remark 3 It is easy to see from Lemma[T3\ that when u > 2 m_1 + 1, any 
u-set is a stopping set since any set with at least 2 m_1 points generates 
PG{m- 1,2). 

Theorem 3 Let H(m) be the [2 m — l,2 m — m — 1,3] Hamming code with 
parity-check matrix # (2) . Let {T^H^)}^ be the SSD ofU(m). Then 

' 1, u = Q, 

0, 11 = 1,2, 

u = 3,...,2— !, 
k C^" 1 ), u = 2 m - 1 + l,...,2 m -l, 

where Npc(m — 1,1) and Gpg{u,1) are defined in @ and (f39j) respectively. 

Proof: Clearly, To = 1 . By Lemma H3] and the definition ([24"]) of 
Gpg(u,1), it is easy to see that 

m—1 

T u = J2 N PG {m - 1, /) G PG (u, /). (42) 
z=o 

Since any u-set in PG(m — 1,2) generates a flat with dimension at least 
Llog u\ , 

B PG (u, I) = G PG (u, I) = if I < [log u\ . (43) 
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Combining (|32"]). (03]) and ([27]), we have that 

min{u— 2,m— 1} 

T u = NpG ( m - X > GpG ^ 0, 1 < « < 2 m - 1. (44) 

1= [log u\ 

Let u = 1,2, we have Ti = T2 = 0. Combining these facts and Remark O 
([TO follows. □ 

Remark 4 5i/ Theorem® we have that 

T 3 (H&) = (2 m - l)(2 m_1 - l)/3, 

T 4 (F (2) ) = (2 m - l)(2 m_1 - l)(2 m - 2 - l)/3. 

It is easy to see from [18 1 that A 3 = T 3 (HW) and A A = T A (H^) for H{m), 
which were also obtained by Weber and Abdel-Ghaffar [27] . 

Example 2 By Theorem [3j we can easily calculate the SSDs for H(m) by 
Mathematica software. Here are some examples for m = 3, 4, 5. 
For 7/(3), 

T(x) = 1 + 7x 3 + 7x 4 + 21x 5 + 7x 6 + x 7 . 

For 7£(4) 3 

T(z) = 1 + 35x 3 + 105x 4 + 483x 5 + 2485x 6 + 5595x 7 + 6315x 8 

+5005x 9 + 3003x 10 + 1365X 11 + 455x 12 + 105x 13 + 15x 14 + x 15 . 

For H(5), 

T(x) = 1 + 155x 3 + 1085x 4 + 8463x 5 + 88573x 6 + 798095x 7 

+4909005x 8 + 16998075x 9 + 41869685x 10 + 83182827s 11 
+140443485x 12 + 206027395x 13 + 265130445x 14 + 300532755x 15 
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+300539699x 16 + 265182525a; 17 + 206253075a; 18 + 141120525a; 19 
+84672315x 20 + 44352165a; 21 + 20160075a; 22 + 7888725a; 23 
+2629575a; 24 + 736281a; 25 + 169911a; 26 + 31465x 27 + 4495a; 28 
+465a; 29 + 31x 30 + x 31 . 

V.3 The First Order Reed-Muller Codes RM(m, 1) 

Throughout this subsection, n = 2 m and EG(m,2) = {1, 2, . . . , 2 m }. By 
([3]), there are iVEG<(m, /-0 /-t-flats in EG(m,2) and a /x-flat has exactly 2^ 
points. The next theorem follows from Lemma [6] immediately. 

Theorem 4 Let RM(m, 1) be the first order Reed-Muller code with parity- 
check matrix H (3 l Let {T;(#( 3 ))}™ =0 be the SSD of RM(m,l). Th 



in 



1 if i = or 2 m , 

N EG (m,n), ifi = 2 m -2», 

H = 0, 1, . . . , m — 1, 
0, otherwise, 



(45) 



where 



i=l 

Remark 5 Let /i = m — 1, by Theorem® it is easy to check that the number 
of smallest stopping sets T 2 m,~i(H^) = 2 m+1 — 2, which coincides with the 
number of minimum codewords of RM(m,l). 

Example 3 By Theorem [H we can easily calculate the SSDs of RM(m, 1) 
with parity-check matrix by Mathematica software. Here are some 

examples for m = 3, 4. 
For RM(3,1), 

T(x) = l + 14x 4 + 28x 6 + 8x 7 + a; 8 . 
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For i?M(4,l), 

T(x) = l + 30x 8 + 140a; 12 + 120x 14 + 16x 15 + x 16 . 
V.4 The Extended Hamming Codes H(m) 

Throughout this subsection, n = 2 m and EG(m, 2) = {1, 2, ... , 2 m }. Note 
that P is a hyperplane if and only if x(P) is a row °f and if and only 

if P = EG(m, 2) \ P is a hyperplane. 

Lemma 14 Let H{m) be the [2 m ,2 m — m — 1,4] extended Hamming code 
with parity-check matrix . Then S C EG(m, 2) is a non-empty stopping 
set if and only if (S) = (Sj) for any j G S. 

Proof: By the definition of stopping sets, a non-empty subset S C 
EG(m,2) is a stopping set if and only if H^(S) has no rows with weight 
one, i.e., \P (1 S\ ^ I or \P (1 S\ ^ \S\ — 1 for any hyperplane P of EG(m,2). 
Since P is a hyperplane in EG(m, 2) if and only if P is also a hyperplane, we 
only need to show that \P T\ S\ ^ \S\ — 1 for any hyperplane P of EG(m, 2) 
if and only if (S) = (Sj) for any j € 5. With the same arguments used in 
the proof of Lemma [T3l the lemma follows. □ 



Remark 6 It is easy to see from Lemma 14 that when u > 2 m_1 + 2, any 
u-set of EG(m, 2) is a stopping set since any set with at least 2 m_1 + l points 
generates EG(m,2). 

Since is formed by all rows except the all-1 row of H^* , they have 
the same SSDs. 
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Theorem 5 Let 7i(m) be the [2 m ,2 m — m — 1,4] extended Hamming code 
with parity- check matrix . Let {Ti(H^)}f =Q be the SSD ofH(m) . Then 



1, u = 0, 

0, u = 1,2,3, 



(46) 



n = 4,...,2 m - 1 + l, 
u = 2 m ~ l + 2, . . . , 2 r 



where N EG (m,l) and G EG (u,l) are defined in @ and §4Q respectively. 

Proof: Clearly, Tq = 1. By Lemma Q31 and the definition (|24p of 
G EG (u,l), it is easy to see that 



T u = J2^E G (mJ) G EG (u,l). 



(47) 



Since any u-set in EG(m, 2) generates a flat with dimension at least [log u] . 



B EG (u,l) = G EG (u,l) = if Z < [log u] . 
Combining (g7])-(g8]) and ([27]), we have that 

min{ii— 2, m} 

T u = Yl N EG (m,l) G EG (u,l), l<u<2 r 

1= [log u] 



(48) 



(49) 



Let u = 1,2,3, we have T\ = T2 = T3 = 0. Combining these results and 
Remark El (05} follows. □ 

Remark 7 By Theorem® we have that 

T 4 (F (4) ) = 2 m ~ 2 (2 m - l)(2 m - 1 - l)/3, T f) {H^) = 0. 

Lt is easy to see from [18] that A 4 = T 4 (H^) and A 5 = for H(m), which 
were also obtained by Weber and Abdel-Ghaffar [27] . 
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VI Conclusions 



Let C be a binary [n, k] linear code. Let H* be the parity-check matrix of 
C which is formed by all the non-zero codewords of its dual code C ± . On 
the BEC, the iterative decoder with parity-check matrix H* achieves the 
best possible performance, but has the highest decoding complexity. The 
stopping set distribution of C with the parity-check matrix H* is used to 
determine the performance of C under iterative decoding with the parity- 
check matrix H* over a BEC. In general, it is difficult to determine the 
stopping set distribution {Ti(H*)}™ =0 of C with the parity-check matrix 
H*. Let H be a parity-check matrix of C. Let {Ti(H)}f =Q be the stopping 
set distribution of C with the parity-check matrix H. Since H is a sub- 
matrix formed by some rows of H*, any stopping set of H* is a stopping 
set of H. This implies that T^H) > T^H*) for every < i < n. A 
parity-check matrix H is called BEC-optimal if Ti(H) = Ti(H*) for every 
< % < n and H has the smallest number of rows. On the BEC, the iterative 
decoder with BEC-optimal parity-check matrix H achieves the best possible 
performance as the iterative decoder with parity-check matrix H* and it 
has lower decoding complexity than H*. In general, it is difficult to obtain 
BEC-optimal parity-check matrix for a general linear code. It is interesting 
to construct BEC-optimal parity-check matrices and then determine the 
corresponding stopping set distributions for LDPC codes and well known 
linear codes. In this paper, we obtain BEC-optimal parity-check matrices 
and then determine the corresponding stopping set distributions for the 
Simplex codes, the Hamming codes, the first order Reed-Muller codes and 
the extended Hamming codes. 
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